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MATRICES WITH ZEROS 
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Abstract. Wg study a class of paramctrizations of convex cones of positive 
semidefinite matrices v^ith prescribed zeros. Each such cone corresponds to 
a graph whose non-edges determine the prescribed zeros. Each parametriza- 
tion in this class is a polynomial map associated with a simplicial complex 
supported on cliques of the graph. The images of the maps are convex cones, 
and the maps can only be surjective onto the cone of zero-constrained positive 
semidefinite matrices when the associated graph is chordal and the simplicial 
complex is the clique complex of the graph. Our main result gives a semi- 
algebraic description of the image of the parametrizations for chordless cycles. 
The work is motivated by the fact that the considered maps correspond to 
Gaussian statistical models with hidden variables. 



1. Introduction 

For a positive integer m, let [m] = {!,..., m}. Denote the power set of F C [m] 
by 2^. A collection of subsets A C 2['"1 is a simplicial complex if 2-'^ C A for all 
F G A. The elements of A are called faces and the inclusion-maximal faces are the 
facets. The ground set of A is the union of its faces. The underlying graph G{A) 
is the simple undirected graph with the ground set as vertex set and the 2-element 
faces as edges. All simplicial complexes appearing in this paper are assumed to 
have ground set [m] and, thus, all underlying graphs have vertex set [m]. We make 
this assumption explicit by speaking of a simplicial complex on [m] . 

Let be the m{m+l)/2 dimensional vector space of symmetric mxm matrices. 
For an undirected graph G with vertex set V{G) = [m] and edge set E{G), define 
the 1-^(0)1 -I- m dimensional subspace 

§"(G) = { S = {(Tij) e : CTy = if i 7^ j and {i, j} ^ E{G) } 

containing the symmetric matrices with zeros at the non-edges of G. Let S™q C S™ 
be the convex cone of positive semidefinite matrices and §™q(G') = §"q n §™(G') 
the convex subconc of matrices with zeros prescribed by the graph. 

This paper is concerned with particular parametrizations of the graphical cone 
§™o(^)- 1^0'" ^ subset A C 2[™1, define the polynomial map 

</)A : n J*""' ^ ^"o 

_F6A 

given by 

0A(7) = r(7)r(7f, 
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where, for 7 = (7i,F : € A,i e F), the [m] x A matrix r(7) has entries 

(1-1) r(7),,^^ 



7i,F F, 
otherwise. 



The coordinates of the map are 



(1-2) 0A(7)y = X! 7^f7j,f, i,jeH- 

FeA : i,j&F 

In particular, the diagonal coordinates 

(1-3) </>a(7)j*= X! "^^V' «eN, 

FeA : ieF 

are sums of squares, which implies that 0a is a proper map, that is, compact sets 
have compact preimages under 0a- 

We will be interested in the situation when A is a simplicial complex on [m]. 
In this case, the map (j)^ is never injective. It has fibers (preimages) of positive 
dimension unless the underlying graph is the empty graph. 

Lemma 1.1. For any simplicial complex A on [m] with underlying graph G = 
G(A), the image of (j)/^ is a closed full-dimensional semi- algebraic subset o/§"q(G'). 

Proof. Hi ^ i and {i, j} is not an edge of G, then no face of A contains both i and 
j. Hence, by \1.2\ . the image is a subset of S™q(G). The image is semi-algebraic 
because 0a is a polynomial map, and it is closed because 0a is proper. 

If A' C A is another simplicial complex with the same underlying graph then the 
image of 0a' is contained in the image of 0a . To show full dimension, we may thus 
assume that A is the complex whose facets are the edges of G. Using the shorthand 
7,; = 7i_{i} and 7^ = 7,;.{i j} in this special case, the non-zero coordinates of 0a are 



4>a{i) 



^ \ll + Efe6H:{^,fe}6A ilk if * = i> 



It is evident that there are no algebraic relations among these coordinates and, 

thus, the image is full-dimensional. □ 

Example 1.2. Let A be the simplicial complex whose facets are the edges {1,2} 
and {2,3} of a three-chain. We have that 

^71 712 

r(7) = I 72 721 723 

73 732, 



and 




712721 

'^a(7) = I 712721 7I+7I1+7I3 723732 

723732 ll + 7I2/ 

It can be shown that 0a is a surjective map onto the entire cone §^q(G), which 
here comprises the tridiagonal positive semidefinitc matrices. The surjectivity claim 
holds as a special case of CoroUarv 13.21 □ 



ON A PARAMETRIZATION OF POSITIVE SEMIDEFINITE MATRICES WITH ZEROS 3 



As we describe in more detail in Section [6l the motivation for considering the 
parametrization 0a comes from statistics. The graphical cones S™q(G') correspond 
to statistical models for the multivariate normal distribution; see |DP07| §2] and 
references therein. The parametrization (/)a is particularly useful for tackling sta- 
tistical problems in covariance graph models, which treat the cone §>-o(G) as a set 
of covariance matrices. The parametrization can be regarded as arising from con- 
structions involving hidden or latent variables |CW961 IRS02| . This connection can 
be exploited in particular for computation of maximum likelihood estimates and 
construction of prior distributions for Bayesian inference |Bar08[ IPDB07j . It also 
allows one to simplify the study of algebraic properties of graphical models based 
on mixed graphs; see |STD10| . 

In Example II. 21 the map 0a is surjective. However, it is known that surjectivity 
need not always hold. The following example has been given in the literature. 

Example 1.3. Let A be the simplicial complex with facets {1, 2}, {1, 3} and {2, 3}, 

and the complete graph as underlying graph. Now, 

712721 713731 
</'a(7) = I 712721 7I+7I1+7I3 723732 




713731 723732 7I + 7I1 + ihj 

Suppose we are given a positive definite matrix S = ((Jy) in §^q(_R'3) = S^q. Define 
the correlation matrix R = (pij) with entries pij = a ij j ^Joiiojj . The matrix R is 
obtained by multiplying S from the left and right with the diagonal matrix that 
has the entries l/^/ou on the diagonal. It follows that E is in the image of 0a if 
and only if R is in the image. For R to be in the image, however, it needs to hold 
that 

(1-4) min {pi2, P13, P23} < 



see [SRM"'"98 . Clearly, there are positive definite matrices in S^q whose correlation 



matrices do not obey this condition. 

Our Theorem 15.31 applies to this example and gives a semi-algebraic description 
of the image of 0a- This description reveals that a positive definite matrix is in 
the image if and only if its correlation matrix R satisfies 

(1-5) 1 - P12 - Pl3 - P23 - 2pi2Pi3P23 > 0. 

If pi2,Pi3, P23 > 1/2, then the left hand side in (jl.Sp is smaller than 1—3/4—2/8 = 0. 
Hence, one may replace 1/V2 by 1/2 in the necessary condition in (|1.4p . which can 
also be seen directly. If i? = 0a (7) has diagonal entries 1, then summing the 
diagonal entries gives 

3 3 

4=1 l<!<j<3 4=1 l<4<i<3 l<i<i<3 

so we must have pij — ^ij^ji < 1/2 for some □ 

This paper explores in detail the images of the maps 0a, which we denote by 
im(0A). In Section [21 we show that the image is always a convex cone and we 
describe its extreme rays. In Section [3l we prove that surjectivity of the map 
can only be achieved if A is the clique complex of a chordal (or decomposable) 
graph. Section |4] collects results relevant for passing to submatrices and Schur 
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complements. In Section [5l we derive the semi-algebraic description of the image 
when the underlying graph is a chordless cycle. The connection to statistical models 
is reviewed in Section [51 

2. Convexity 

The set S™q of positive scmidefinite m x m matrices forms a full-dimensional 
convex cone in the m(m + l)/2 dimensional vector space of m x m symmetric 
matrices. A ray of S"q is the set of non-negative scalar multiples of some non-zero 
matrix in S"g. An extreme ray is a ray that cannot be written as a positive linear 
combination of two distinct rays. The extreme rays of §"g are given by the positive 
scmidefinite matrices of rank 1. Hence, §™q is the convex hull of its rank 1 elements. 

For F C [m], let SyQ{F) be the convex cone of positive semidefinite matrices 
that have zeros outside the F x F submatrix. 

Theorem 2.1. For any simplicial complex A on [m], the image of 4>\ is a convex 
cone. The matrices on the extreme rays of the image are the rank one matrices that 
are in S™Q(i^) for some face F S A. In other words, im((/)A) = X^FeA ^™o(^)- 

Proof. Elements of the image of the map (j)/^ are of the form 

E ni)FnifF. 

where T{'^)p is the column of r(7) corresponding to face F. This column can be 
any vector in R™ that has i-th entry zero for each i ^ F. It is clear that the image 
of (pA is closed under positive scaling. We will show that it is closed under addition, 
by induction on the maximal cardinality of a face in A. 

If all faces have size 1 then the image of 0a consists of all positive semidefinite 
diagonal matrices and is convex. Let _F be a facet of A and suppose it has cardinality 
at least 2. Consider the matrix 

s = r(7)j.r(7)|; + r(7')Fr(7')F 

and its Cholesky decomposition S = LL"'", where L is a lower triangular matrix. 
Since E € S™q(F), each column of the Cholesky factor L has support in F. In fact 
only the first column of L may have support equal to F; denote this column by 
Li. All other columns of L have support strictly smaller than F. These smaller 
supports correspond to subfaces of F, so they are in A. Hence, S is the sum of 
LiLf and an element in the image of (f'A\{F}- (Removing a facet leaves us with 
another simplicial complex.) Repeating this process for all other faces of maximal 
cardinality in A and using the inductive hypothesis, we see that the image of 0a 
is closed under addition. 

Suppose a non-zero matrix E is on an extreme ray of the convex cone im((/)A). 
Then E = Ei +E2 for some non-zero and distinct matrices Ei, E2 in the same cone 
implies that both Ei and E2 are scalar multiples of E. From the definition, any 
element in the image of (j)A is a sum of rank one matrices in it, so only rank one 
matrices can be on the extreme rays. Moreover, any rank one positive semidefinite 
matrix is on an extreme ray of §™g, so it is also on an extreme ray of the convex 
subcone im((/)A) that contains it. A rank one matrix in im{(pA) is of the form vv'^ 
for some vector v G M™ whose support F is a face of A. Hence, vv^ £ §™q(J^). □ 
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A clique in an undirected graph G with vertex set [to] is a subset F C [m] such 
that for any pair of distinct vertices i,j^F, {i, j} is in E{G). The set of all cliques 
in G forms a siniplicial complex on [m] and is called the clique complex of G. 

Corollary 2.2. Let A 6e a simplicial complex on [to] with underlying graph G. 
Then the extreme rays of the image of(f>A consist of all rank one matrices mS™Q(G) 
if and only if A consists of all the cliques in G. 

3. SURJECTIVITY 

The maximal rank of a matrix lying on an extreme ray of §"q(G') is called the 
sparsity order of the graph G and denoted ord(G'). A subgraph if of G is called an 
induced subgraph if for all pairs of vertices i,j in G E{H) {i,j} S 

E{G). A graph is called chordal if it does not contain any chordless cycle of size 
more than three as an induced subgraph. The following results are known in the 
literature jAHMR88l IHPR89I ILauOl) . 

Theorem 3.1. For a graph G with m vertices, 

(i) 1 < ord(G) < TO - 2, 

(ii) ord(G) = 1 if and only if G is chordal, 

(iii) ord(G) = to — 2 if and only if m < S or G is a chordless cycle, and 

(iv) if H is an induced subgraph of G, then ord(iJ) < ord(G). 

These results readily allow one to characterize when the parametrization c/ia fills 
all of the graphical cone §"q(G). 

Corollary 3.2. Let IS. be a simplicial complex and G a graph on [to]. The map 
is surjective onto §™q(G) if and only if G is chordal and A is its clique complex. 

Proof. (Sufficiency) If A contains all cliques in G, then im(0A) contains all rank 
one matrices in S"q(G). If G is chordal, then its sparsity order is one, so S"q(G) is 
generated by rank one matrices in it. Hence, im(0A) = SyoiG) and (j)^ is surjective. 

(Necessity) First note that the image of (/)a is a subset of §™q(G) only if all sets 
in A are cliques of G. 

Let A be the clique complex of G. If G is not chordal, then there is an induced 
subgraph that is a chordless cycle of size at least 4. So ord(G) > 2, and there is 
an extreme ray of S"q(G) containing matrices of rank at least two. This ray is 
not in the convex cone im(0A), so 0a is not surjective. It follows that (p^i is not 
surjective for any (arbitrary) subset A' of A. 

Suppose A does not contain a clique F in G. Let v G M™ be a vector with 
support F. Then vv'^ is a rank one element of §™q(G). It lies in an extreme ray of 
§™o(^) because it lies in an extreme ray of the larger cone §™q. Hence, it cannot 
be written as a sum of other elements in §"q(G), so it is not in im(0A), and 0a is 
not surjective. □ 

Remark 3.3. The sufficiency of the condition in Corollarv 13.21 can also be proved 
by using the Cholesky decomposition to compute a point in the fiber 0^^(I]) of a 
matrix T, € S™g(G). The vertices of a chordal graph G can be brought into a perfect 
elimination ordering, which ensures sparsity of the lower-triangular Cholesky factor; 
see for example |PPS89| Thm. 2.4]. Suppose the original vertices 1,...,to are 
already in such an order. Then E — LL'^ for a lower-triangular matrix L — (lij) 
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with lij = when i =^ j and {i, j} is not an edge of G. The support of each column 
of L is thus a chque in G. It follows that S e ini((/)A). 

The necessity of the chordality condition in Corollary 13.21 also follows from our 
semi-algebraic characterization of im(0A) when A is the clique complex of a chord- 
less cycle; see Section [5] that also gives an example of a matrix not in the image. □ 

In the statistical literature, the parametrization is most commonly considered 
for a simplicial complex A given by the edges of a graph. The parametrization for 
such an edge complex is surjective only for chordal graphs whose cliques are of 
cardinality at most two. This means that there may not be any cycles. 

Corollary 3.4. The edge complex A of a graph G yields a surjective parametriza- 
tion (/)A of §™q(G) if and only if G is a forest (has no cycles). 



For a simplicial complex A on [m] and a subset A C [m], define the induced 
subcomplcx Aa = {F e A : F C A}. 

Lemma 4.1. Let A be a simplicial complex on [m]. If is a matrix in the image 
o/0A; then all proper principal submatrices "Sa.a, A C [m\, are in the image of the 
respective induced subcomplcx 4'Aa ■ 

Proof Write S = r(7)r(7)'^. Let TAh) be the submatrix of r(7) obtained by 
removing all rows with index not in A. Then 'Ea,a = ryi(7)r^(7)-^-|-diag(7') where 
7i = Y,FeA\AA^lF- The matrix TAi'j)TAilV is in the image of 0Aa: and so is 
the diagonal matrix diag(7'). By convexity (Theorem 12. ip . J2a,a G im(0A.4)- D 

The converse of the lemma does not hold. If A is the edge complex of a chordless 
cycle, then any matrix in §™q(G) has all of its proper principal submatrices in the 
image of the corresponding map 0Aai but im{(f)G) £ §"q(G) by Corollarv l3.2l 

For a square matrix M partitioned as 



the Schur complement of a non-singular submatrix D in AI is defined as M / D :~ 
A — BD^^C. If M is symmetric positive semidefinite, then so is M/D. If D is 
further partitioned as 



and H and D/H are non-singular, then the following quotient formula holds: 
M/D = {AI / H) / {D / H). Proofs can be found in textbooks on matrix theory. 

For a graph G — {V, E) and a proper subset of vertices U C V, define a new 
graph G/U on vertex set V\U as follows. A pair {i,j} C V\U is an edge in G/U 
if {i, j} is an edge in G or there is a path between i and j in G through vertices in 
U. For a simplicial complex A on ground set V, define a new simplicial complex 
A/J7 on V\U where a set A C V\U forms a face if it is a face in A or there exists a 
sequence of distinct elements ui,U2j ■ ■ ■ ,Uk G U and distinct faces i^i, . . . , Fk+i € A 
such that Ui & Fi n i^i+i and A = lJ*Lt/ Fi\U. If the faces of A form cliques in G, 
then the faces of A/t/ form cliques in G/U. 



4. Submatrices and Schur complements 
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Proposition 4.2. Let A be a simplicial complex on [m] and U C [to] a proper 
subset of nodes. If S is in the image of 0a and 'Eu^u is non-singular, then the 
Schur complement Yi/Y,jj.u is in the image of (j)^/u. 

Proof. If U' is a non-empty proper subset of U, then by the quotient formula we 
have S/Sc/^c/ = iJ:/^u',U')/{^u,u/^U',U')- Moreover, A/U = {A/U')/{U\U') by 
construction. Therefore, it suffices to prove the assertion when U consists of only 
one vertex u. We call a face F of the complex A/u := A/{u} original if F is also 
a face of A and induced ii F ~ {Fi U F2)\{u} for a pair of distinct faces Fi, F2 of 
A that both contain u. Note that a face can be both original and induced. 

Let S = r(7)r(7)^ be in the image of (/)a- Define as follows a new matrix 
rA/it(7') = [I'v f] whose rows and columns are indexed by the vertices and the 
induced faces of A/u, respectively. Fix an arbitrary total order "<" on the faces 
of A. For the induced face F = {Fi U F2)\{u} given by a pair of faces Fi < F2 of 
A with M e Fi n F2, let 

Here, jip- is shorthand for 7i,F and "fip = Q i ^ Fj. 
Let A = V\{u}. We now show the following: 

(4.1) s/E„,„ := j:a,a - ^^'"^"-^ = rA,(7)rA.(7)'^ + rA/„(7')rA/«(7')^, 

where Fa^ (7) is the submatrix of F(7) with rows and columns indexed respectively 
by A and faces F £ A contained in A. The ij'-entry on the right hand side is 

Y 7»-F7jF + Y iiFl'j^F 
FeA/u FeA/ti 
F original F induced 

= Y I'^FlsF + — Y (^'-P^i '^"^^ - 1^F2 luFi ) {jjFi luF2 ~ I3F2 luF, ) 
FeA """" Fi<F2eA 

u<^F u£FinF2 



= 2^ 7*F7jF + 2^ {~liF^ J3F2 7«Fi 7uF2 + 7zFi J3F1 luF2 ) 

FeA """" FiT^FseA 

u^F ueFinF2 

^^^^:>P + '~~ (~^^Fi 7jF2 7«Fi 7«F2 + 7»Fi 7jFi 7uF2 ) 

FgA Fi,F2eA 

u^F ueFinF2 

■- Y ^'^FljF + Y T^-Pi^J-Pi Y '^^F2 - Y 7iFi7jF2 7«Fi7«F2 

FeA FiSA FseA Fi.FsSA 

u^F ueFi ueF2 iieFinF2 



■Y^^p^^p-^ Y 

FeA Fi,F2 6A 

tiGFinF2 



7iFi7jF2 7«Fi7«F2, 



which is equal to the zj-entry on the left hand side because (Ty = X]FeA7*F7iF- 
From (|4.ip and the convexity of im(0A/«) shown in Theorem 12.11 it follows that 
Schur complement S/Su ^ is in the image of (f>A/u- O 



The converse of Proposition 14.21 cannot hold in general. Let G be a 3-cycle and 
consider (j)c given by the edge complex of G. Then any Schur complement E/Eti.„ 
of E S SyQ{G) is in im(0(3/{„}), but not every such matrix S is in im{(j)G). 
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5. Chordless cycles 

Let Cm be the chordless m-cycle with edges {1, 2}, {2, 3}, . . . , {1, m}. Excluding 
trivial cases, assume that m > 3. Let A be the simplicial complex whose facets are 
the edges of Cm, and define (jjc^ = (f'A- For m > 4, there is no other simplicial 
complex A' that gives a parametrization c/ja' whose image is a full-dimensional 
subset of SyQ{Cm)- In this section we give a semi-algebraic description of im(0c'^J. 

We begin with a simple yet important observation. For a symmetric matrix 
S G §™ and two distinct indices i,j e [m], define S*^*^^ to be the symmetric matrix 
obtained by negating the (i, j) and (j, i) entries of S. 

Lemma 5.1. Suppose S G §"o ^ positive semidefinite matrix, and A is the edge 
complex of a graph. If i ^ j and {i,j} £ A, then S is in the image of 0a */ o,nd 
only i/E^'-') is in im(0A)- 

Proof. If S = </>a(7), then S^'-'^ = 0a (7), where 7 is identical to 7 except for 
the single entry 7^ = 7i,{ij} that is replaced by its negative — 7ij. The entry jji 
remains unchanged. □ 



Note that Lemma [O] immediately yields the necessary condition stated in (|1.5p 
in Example 11.31 about C3 ~ K^, the complete graph on 3 nodes. The lemma 
can also be used to give an explicit example of a matrix not in the image of the 
parametrization for Cm, to > 3. 



Example 5.2. For m > 3, define the symmetric m x m matrix 



/I 

1 
2 



V2P 



1 
2 

1/ 



where all omitted entries are zero such that G S™(Cm). Omitting the m-th 

row and column of yields a positive definite tridiagonal matrix. Hence, 
is in the graphical cone S'^^giCm) if and only if dct(I](p)) > 0. Using Laplace 
expansions and the recursive formula for the determinant of a tridiagonal matrix, 
one can show that 



detE(p) 



[TO 

[to 



+ 1 — (to — 1)/?] (1 + p) if TO is odd, 
+ l + {m-l)p]{l- p) if) 



TO IS even. 



If TO is odd, choose p E (1, 1 + 2/(m — 1)). If to is even, choose p E (—1 — 2/(m — 
1),— 1). Then the determinant of T,{p) is positive but the determinant of p) 
is negative. Since E(p)(^'") = Y,{—p), it follows from Lemma (5. II that T,{p) is in 
§™Q(Cm) but not in the image of (f>Cm- ^ 

We now state the main result of this section, a semi-algebraic description of 
the image of 0c,„- Let Ai{Cm) be the collection of all (not necessarily maximal) 
matchings of Cm- A matching is any set M of pairwise disjoint edges, that is, 
{i,j},{kj} <E M implies that {i,j} D {k,l} = 0. For M € 7W(C™), we write 
[to] \ M to denote the set of nodes not incident to any edge in M. If E = (cy ) is a 
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matrix in S™q (Cm) then its determinant can be expanded as 

m 

(5.1) det(E)=(-ir+i.2n'^M+i + E (-1)"" n 4 n 

i=l M£M{Cm) {i,j}eM is [m]\M 

compare [CDS951 §1.4, eqn. (1.42)]. In the first term, which corresponds to the 
entire cycle Cm, the indices are read modulo m such that (Tm,,n+i = crim- The 
following theorem is the main result of this section. 

Theorem 5.3. A matrix E = (cy) G §"o(C'm) is in the image of (f>c^ if and only 

E (-1)"" n 4- n ^ sni-M+ii- 

MeA^(C™) {ij}eA/ is [m]\A/ i=l 

Proof. (Necessity) A matrix S G im((?!)c:^) is positive semidefinite and thus has a 
non-ncgativc determinant. Pick any edge in Cm, say {1,2}. Then, by Lemma l5.1[ 
E^^^) is positive semidefinite. Hence, 

min|dct(I]),dct(E(i2))| ^ 

m 

-2nkM+ii+ E (-1)"" n 4 n ^^^^ ^ o. 

i=l MeM{C„,) ■ie[m]\M 

(Sufficiency) We need to show that under the assumed condition on E G §>-o(C'm), 
the equation system (f>Cm{l) = ^ l^^-s a feasible solution (7) in (M)^ x (R^)^. Our 
proof will show that 7^ {ij docs not play an important role and can simply be set 
to zero. Since im{(f>c^) is closed and full-dimensional in EyoiG), it suffices to show 
that a dense (Zariski open) subset of points E satisfying the necessity condition is 
contained in mi{(f>c^)- We show that for positive definite E, any complex solution 
7 (with 7,,{i} — for alH = 1, . . . , m) is in fact real and thus feasible (Lcmma l5.5l) . 
The proof is completed by demonstrating the existence of complex solutions for 
generic E (Lemma 15. 6p . □ 

The following is an immediate consequence of Theorem 15.31 

Corollary 5.4. For a positive semidefinite matrix E ~ (dy ) in SyoiCm) the fol- 
lowing are equivalent: 

(1) T. is in the image of (pc^- 

(2) E^*^-* is positive semidefinite for all edges ij £ Cm- 

(3) E*^*^-* is positive semidefinite for some edge ij G Cm- 

Proof- By Lemma TS.li we have (1) implies (2). It is obvious that (2) implies (3). 
If both E and E^*^^ have non-negative determinants for some edge ij G Cm, then 
the inequality in Theorem 15. 31 is satisfied, so we have (3) implies (1). □ 

The semi-algebraic condition from Theorem l5.3l is easily verified, and we can use 
it to compute the spherical volume of the cone im(0c^ ) by Monte Carlo integration. 
Table [T] shows which fraction of the cone S^o(Cm) is covered by the image of (/)c™j 
when quantifying this by the ratio of the spherical volumes of the two cones. The 
rounded ratios were computed by simulating 100,000 matrices in §^o(C,n). In terms 
of the ratio of spherical volumes, the difference between im{(j>Cm) ^^'^ ^yo{Cm) is 
largest for m = 3 and becomes rather minor for m = 6,7. 
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Table 1. Spherical volume of the image of (j)c^ as a fraction of 
the spherical volume of the cone Syo{Cm)- 



m 


3 


4 


5 


6 


7 


Vol 


0.78 


0.90 


0.95 


0.98 


0.99 



The remainder of the section is devoted to the details of the proof of the suffi- 
ciency of the condition in Theorem 15.31 As mentioned above, our approach is to 
study the equation system 0a (7) = S for a given matrix S = {(Tij) G Syo{G), 
which is treated as a parameter to the system. For A = E{C'm), the equations take 
the form: 



(5.2a) 
(5.2b) 



2 I 2 



1 +7i,i+i = i = l,...,m, 

= i = 1, . . . , m. 

where 7,;^ denotes 7i,{i.j} and indices are read modulo m such that = m and 
1 = m + 1. The 2m equations in (j5.2ap and (|5.2bp involve 3m unknowns and have 
an m-dimensional solution set in C^™. In the sequel we simply omit the unknowns 
7i .{i} from the system. In other words, we study the 2m equations in 2m unknowns: 



(5.3a) 

(5.3b) Ji^i,at,i-i 

We will show that system ()5.3a|) - (j5.3bp has a real solution if S satisfies the 
condition from Theorem 15.31 which will imply that the system ()5.2a|) - ()5.2a|) has 
a real solution, too. Somewhat surprisingly it suffices to argue that they have a 
complex solution, as is made precise in the next lemma. 

Lemma 5.5. // a positive definite matrix E € S)-o(Cm) satisfies the necessary 
condition from Theorem \5.3[ then all complex solutions to the equations Il5.3a\} - 
Ii5.3b\) are in fact real. 



Proof. Suppose the vector 7 e (C^)^ provides a solution to (j5.3ap - (j5.3bp . Fill the 
2m unknowns in a matrix r(7) G C^^^ ~ £;mxm -^^ (|l.ip . Note that we are 
setting 7i,{i} = for alH = 1, . . . , m, so the columns in r(7) corresponding to the 
singleton faces {l},...,{m} are zero and can be omitted. Augment r(7) to an 
(m + 1) X m matrix ^(12) by adding the vector (712, 0, . . . , 0) as a first row. Based 
on the equations (|5.3ap - (|5.3bp . 



(5.4) 



r(i2)rfi2) 



/7?2 
7?2 
0'12 



v 



7?2 

0-11 

0'12 



0'12 
0'12 
^22 

0'23 



CT23 
f33 



with blank entries being zero. The (m + 1) x (m + 1) matrix r(i2)r^2) rank 
at most m, and thus its determinant vanishes. Therefore, 712 has to satisfy the 
quartic equation 



(5.5) 



det 



(r(i2)rfi2)) = a'j^2 + fnli + 



c = 0. 
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By expanding the determinant of (|5.4p along the first row (or column), the coeffi- 
cients in (15.51) are found to be: 



det T. 



m]\{l}Jm]\{l}j 



b = det(I]) + 2cr?2 det (S[,„]\{l,2},[m]\{l,2}) + (-1)" • 2 n 



i=l 



-(712 det (S[m]\{2},[m]\{2}j 



Note that the third term in b cancels out a term in det(E); recall (|5.f p . It remains to 
argue that under the assumption on E, the quartic in (|5.5|) has only real solutions. 
Define E*^^^) by negating ai2 as in Lemma |5. II Then the assumption on E implies 
that both det(E) and det(E(-^^)) are positive. 

First, we claim that the discriminant b^ — 4ac is positive because 



(5.6) 
Since 



62_4ac:=:dct(E)dct(E(^2)) 



(5.7) dct(E) + (-I)'" • 2 Yl = dct(E(i2)) _ (_i)™ . 2 [] 

we can write 



i=l 



i=l 



6^== det(E) + 2a?2 det (E[„]\{i,2},H\{i,2}) +(-!)"• 2 n-^-^-i.* x 

m 

det(E(i2)) + 2al^ det (E[„]\{i,2},H\{i,2}) - (-1)" • 2 [] 

4=1 

Multiplying out the product, and using (|5.7p once more, yields that 

m 

(5.8) b^ = dct(E) dct(E(i2)) + iaf^ det(E[„]\{i,2},[rn]\{i,2})' + 41] 

i=l 

2a22 det(E[,„]\{i,2}j„]\{i,2}) (dct(E) -f det(E(i2))) . 
Expansion of determinants shows that 

det(E) = an dct(S[,„]\{i},[„i]\{i}) - 0-^2 dct(E[,„]\{i^2},[m]\{i,2}) 

- af^ dct(E[m_i]\{i}_[^_i]\{i}) - (-1)™ • 2 J] (Jj_i,j. 

i=l 

Hence, 

(5.9) det(E) + det(S(i2)) = 2an det(E[„]\{i},[„]\{i}) 

- 20-^2 det(E[,„]\{i_2},[m]\{i,2}) - 2cri,„ det(E[„_i]\{i}_[„_i]\{i}). 
Moreover, we find from another expansion that 

(5.10) det(S[,,„]\{2},[,„]\{2}) = 

(Til det(E[,,„]\{i_2},[m]\{l,2}) + f^lm det (E[„_ i]\{ i^} , [m- 1]\{1,2} ) • 
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Combining ()5.8|) . (|5.9p and (|5.10p . we obtain that our claim (|5.6p holds if 

(5.11) det(I][„]\{i} det(i;[„_i]\{i 2},[m-l]\{l,2}) = 

m 

^12^1m dct(i;[™]\{i,2},[m]\{l,2}) det(E[„_i]\{i} - J]^ Crf-i^j- 

i=l 

However, all determinants appearing in ()5.1ip arc determinants of tridiagonal ma- 
trices and thus (|5.1ip can be shown to hold by an induction on to. 

As just established, — Aac > 0. Moreover, since we assume that both det(I]) 
and det{T,^^^'>) are positive it holds that 6 > 0; see e.g. ()5.8p . In addition, a and 
c are both negative, and it follows from the usual formula for the solutions of a 
quadratic equation that all four solutions to the quartic equation in (|5.5p are real. 
Hence, 712 is real and, by symmetry, the same is true for all other components of 
a solution to (|5.3ap - (|5.3bp . □ 

In the final step that completes the proof of sufficiency of the condition in Theo- 
rem (531 we show that for a generic choice of E, the equations (|5.3a|) - ()5.3b|) in- 
deed have at least one complex solution. We are able to restrict attention to 
generic choices of the entries of E because im((/)c„ ) is closed and full-dimensional 
in SyolCm)- In particular, we may assume that CTi_i,i 7^ for all i G [to]. This 
implies that a solution of (|5.3ap - (j5.3bp has all components non-zero. Moreover, the 
solution set of (|5.3ap - ()5.3bp is identical, up to sign, to that of the rational system 

lh+i + ^ '^"^ j = l,...,m. 

Or simpler yet, setting Xi = 7^-1. ^ (in particular, xq = Xm), the solution set corre- 
sponds exactly to the solution set of the polynomial system 

(5.12) xf^j^xf - (Tuxf + (jf^j^ .^ ^ 0, i = l,...,TO, 
in the torus (C*)'" = (C\ {0})". 

Lemma 5.6. For generic choices of the coefficients Uij, the equations 115. have 
2™+i solutions m the torus (C*)™. 

Proof. We can rewrite the equation system in (|5.12p as 

2 

2 _ _ ■ _ 1 

X,; I 1 CT-li rf , 1 — i, . . . , TO. 

Solving the equation for z = 1 for X2 , plugging the result into the equation for i = 2 
and solving for X3, and continuing on in this fashion with all of the first m — 1 
equations, we can write for each i = 2, . . . , to, 

9 CiiXi ^ bi 
Xi - 



Cix\ di 

where ai,bi,Ci,di are polynomials in the coefficients cFkk^af,^^ j.. From the last 
equation, we then obtain that 

9 ax? -f- b 
(5-13) xl = 



where a, 6, c, d are again polynomials in the coefficients akk,cFf._i 



k- 
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Now specialize to the case of all akk = 1 and all = —1. Then we get 

2 _ X? + 1 2 _ 2a;2 + 1 



and finally equation (|5.13p becomes 
(5.14) x' 



where Fm is the m*^ term of the Fibonacci sequence 1,1,2,3,.... Clearing denom- 
inators, (|5.14p simplifies to — — 1 = 0. This equation is obviously not identical 
to a;" = or X = 0, and its discriminant is not identically zero. The coefficients in 
(|5.13p being polynomial, it follows that for generic complex numbers akk,o'k-i fcj 
the equation in (|5.13p has two distinct non-zero solutions up to sign, and the system 
([O^ has 2"^+! solutions. □ 

Lemma 5.7. For any positive definite matrix E = i<^ij) in image of (f>c^, the 
fiber {7 : (pCmi'y) = ^ OLnd 7ij{i} = for all i = 1, . . . , m} consists of exactly 2™+^ 
elements, or two elements up to sign. 

Proof. First consider the case when all Ci^i+i are non-zero. Since the elements of 
the fiber are in bijection with the solutions of (j5.12p under setting Xi = 7^-1, i, it 
suffices to show that (|5.12p has 2™+^ solutions. For generic E, this was done in 
Lcmma [5.6l For an arbitrary E, let E„ be a sequence of generic matrices in im(0c„) 
that converges to E. Each of the 2'"+^ solutions for E„ can be expressed in terms 
of radicals using (jS.Sp and (|5.12p . and each of these 2™+^ sequences converge to 
solutions of (|5.12p for E by continuity. Moreover the limit points arc distinct 
because the discriminant — Aac in (jS.Sp is positive for S as shown the proof of 
Lemma 15.51 and all Xi in a solution must be non-zero. 

Now suppose (T12 = 0. In this case Lemma [5.51 still holds but Lemma [5.61 does 
not apply. We will now show that the system (|5.3ap - (j5.3b[) still has 2"'+^ complex 
solutions. Since ai2 = 0, we have either 712 = or 721 = 0. If 721 = 0, then 
we can determine 723, 732, 734, 743, 71, m, 712 hi that order along the cycle, 
using (|5.3ap and (j5.3bp alternatingly. These equations show that the sequence of 
7ij obtained this way is unique up to sign unless we get "fi.i+i = for some i. 
However, if jiA+i — 0, then the principal submatrix of E indexed by {2, 3, . . . , i} 
would be equal to r(7)r(7)-'" where r(7) is defined as in the introduction for the 
subgraph on vertices 2, 3, . . . , i and edges {2, 3}, . . . , {i — 1, i}. Then r(7) would 
have more rows than non-zero columns since 7i,{i} = for all i, so r(7)r(7)"^ would 
not have full rank, contradicting the hypothesis that E is positive definite. Hence 
7j^i_l_i 7^ for all i, and setting 721 = determines all other 7^ up to sign. There 
are two choices of signs for each pair 7i,i+i and 7i+i.i, even if cr^.i+i = 0, so there 
arc 2™ solutions with 721 =0. 

By symmetry, if 712 = 0, then we can determine 71,™, 7m,ii 7m,m-i, ■ • • ,723,721 
in that order (going around the cycle in the other direction, with 7i,i-i 7^ in this 
case), so there are 2™ solutions when 712 = also. We cannot have both 721 = 
and 712 = because that would imply that r(7)r(7)^ is singular. So there are 
2Tn+i (jigtinct solutions (two solutions up to sign) to the system (|5.3ap - (j5.3bp when 
cri2 = 0. By symmetry, there are 2™+^ solutions for every E S im{(j>Cm)- '-' 
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6. Statistical models and bipartite acyclic digraphs 

In probability theory, positive semidefinite matrices arise as covariancc matrices 
of random vectors. When the random vector Y = (Yi, . . . , Ym) is Gaussian (has a 
muhivariate normal distribution) with covariance matrix S = (cTy ), then aij = is 
equivalent to the stochastic independence of the two random variables Yi and Yj. 
Hence, the convex cone §™q(G) of positive semidefinite matrices with zeros at the 
non-edges of a graph G collects all covariance matrices for which the components 
of Y exhibit a pattern of independences. 

For a simplicial complex A on [to] with underlying graph G, the map (/)a traces 
out a full-dimensional subset of §™g(G). This subset arises quite naturally for 
random vectors whose components are linear combinations of a set of independent 
random variables. We review this construction next. 

Let A2 be the set of all faces in A that have cardinality at least two. Introduce 
the random variables Si, i € [to], and Hp, F g A2. Suppose the random variables 
Hp are mutually independent with a standard normal distribution, denoted A/'(0, 1). 
Suppose further that the ei are mutually independent, independent of the Hp, and 
distributed as -^i^^^i {i}) where 7f|j} is the variance. Define new random 
variables Yi, . . . , Ym as linear combinations: 

(6.1) Yi= -fi^pHp + e^, ie[m]. 

Proposition 6.1. The random vector Y = (li, . . . ,Ym) defined by i6.1\) has the 

positive semidefinite matrix 0a (7) «s covariance matrix. 

Proof. Write / for the identity matrix (of the appropriate size). Let s — (ei , . . . , Sm) 
and H = {Hp : F e A2). The concatenation {e,H) is a random vector with the 
diagonal |A| x |A| covariance matrix 

(6.2) ^,= (^diag(7r.«) 0^. 

Let r2(7) be the submatrix of r(7) obtained by retaining only the columns corre- 
sponding to faces in A2; recall (|l.ip . Define the |A| x |A| matrix 

(6.3) A=(J 

Multiplying A with {Y,H)'^ gives the vector {e,H)^. By standard results about 
linear combinations of random variables, it follows that the Gaussian random vector 
{Y,H) has covariance matrix A^^fiA^^. The covariance matrix of Y alone is the 
principal submatrix given by the first to rows and columns of A^^ilA^^. The 
inverse A^^ is obtained by negating the upper right block, which becomes simply 
r2(7). It follows that, as claimed, 

diag(7r.{,}) + r2(7)r2(7)'^ = r(7)r(7)^ = 0a(7)- □ 

In the field of graphical statistical modelling, it is customary to visualize an 
equation system such as (|6.ip by means of an acyclic digraph; sec for instance 
|DSS09[ Chap. 3]. Here, we draw the digraph Da that has vertex set A and the 
edges F — > {i} for all pairs of an index i G [to] and a face F G A2 with i G F. 
Note that Da is bipartite with respect to the partitioning A — Ai U A2, where 
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Figure 1. A simplicial complex (left) and the acyclic bipartite 
digraph corresponding to it (right). 



Ai = {{i} : i G [m]} are the singleton faces and A2 was defined above. See Figure 
[T]for an example. 

In the setup of Proposition 16. 1[ the random variables Yi are functions of the 
hidden variables Hp, up to the noise given by the e^. There is a dual construction 
in which the hidden variables are functions of the observed variables. Suppose that 
the random variables Yi are mutually independent and normally distributed as 
Yi ~ A^(0, I/Tj^ ji}) with 7,^{-,j} 7^ 0. Suppose further that up, P & ^^2, are mutually 
independent A/'(0, 1) random variables that are also independent of the Y. Define 
random variables Hp as linear combinations: 



(6.4) 



Hp = 2^ %,fYi + vp, 

ie\va\:ieF 



F G A2. 



Note that this equation system is associated with the bipartite acyclic digraph 
obtained by reversing the direction of all edges in Z?a • 

Proposition 6.2. // the random vector H = {Hp : F £ A2) is defined by 

then the positive definite matrix c/'a(7) is the inverse of the covariance matrix of 

the conditional distribution ofY given H. 

Proof. Concatenating Y and H yields a Gaussian random vector with covariance 
matrix 



' diag(l/72^^j) diag(l/72^,^)r2(7) ' 

r2(7)^diag(l/7i^^^,j) / + r2(7)^diag(l/7^^^,j)r2(7)^ 



where we have reused the matrices appearing in (|6.2p and (|6.3p . By standard results 
about conditional distributions of Gaussian random vectors, the covariance matrix 
of the conditional distribution of Y given H is the Schur complement 



diag(7,-{^}) ^- 



''r2(7) 



r2(7)^diag(72 



diag(7j^,{i}) ^r2(7) (/ + r2(7)^diag(7^ '-2\i)j >-2\ij uiagv7»,{i} 

It follows from the matrix inversion lemma that the inverse of the conditional 
covariance matrix is 

,.2 ^ I "p f^,\r- /^,\T 



diag(7i,{»} 



) + r2(7)r2(7)' =0a(7)- 



□ 
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According to Proposition 16.21 positive definite matrices in mi{(t>A) also arise as 
inverses of conditional covariance matrices. Zeros in the inverse of the covariance 
matrix of a Gaussian random vector have an appealing interpretation in terms of 
conditional independence; see again [DSS091 Chap. 3]. 
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